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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments with respect to claims 1,10, and 37 have been considered 
but are moot in view of the new ground(s) of rejection. 

2. Applicant's arguments filed June 5, 2009, regarding claim 21 , have been fully 
considered but they are not persuasive. 

Applicant argues with respect to claim 21 that MacAulay does not disclose or 
suggest a light emitting section including light emitting elements which emit light based 
on video signals to reproduce the different images at different outgoing angles of light 
and at different times, wherein the different images are perceived by a viewer as a 
three-dimensional image and are perceived by the viewer as a different three- 
dimensional image when the viewer observes the different images from a different 
direction, as required by amended claim 21. 

However, the combination of Holzbach and MacAulay teaches this limitation. 
Holzbach teaches the display of three-dimensional images (full parallax 3D images; col. 
9, lines 29-32) with a light emitting section including light emitting elements which emit 
light based on video signals (LEDs in the lenslet projector modules; col. 9, lines 5-7) to 
reproduce the different images at different outgoing angles (lenslet contains elements to 
direct light in the appropriate direction to create the parallax image; see also DMD of 
col. 9, lines 7-8) of light and at different times (inherent in a moving picture display; col. 
9, lines 20-23), wherein the different images are perceived by a viewer as a three- 
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dimensional image and are perceived by the viewer as a different three- dimensional 
image when the viewer observes the different images from a different direction (inherent 
in an autostereoscopic parallax display; i.e., the depth resolution changes as the 
viewing position changes. "An autostereoscopic display allows an observer to move 
around within a wide range of viewing positions, always presenting the correct 
information to the observer's eyes." See col. 5, lines 21-24.). Since the combination of 
Holzbach and MacAulay teaches this amended limitation, the rejection of claim 21 is 
sustained. 

Claim Rejections - 35 USC § 103 

3. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

4. Claims 1-5, 8, 10, 21, and 37 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over MacAulay (US 6,483,641) in view of Holzbach (US 6,795,241). 

Claim 1, MacAulay teaches a three-dimensional image pickup apparatus in Fig. 3, 
comprising: 

• a plurality of light receiving elements for receiving and converting light into an 
electric signal (light detector 26 that comprises an array of individual detection 
pixels; col. 17, lines 46-50); and 
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• a plurality of light path selection elements for selecting different incoming angles of 
light to come to said light receiving elements at different times (spatial light 
modulator, e.g. digital micromirror device 34; col. 16, line 62-col. 17, line 9); 

• said light receiving elements and said light path selection elements being arranged 
such that a plurality of pixels formed from said light receiving elements and said light 
path selection elements are disposed both in a row direction and a column direction 
(detection array and SLM array are aligned with each other; col. 17, lines 55-58, Fig. 
4; 

• intensities of the light received by said light receiving elements and the 
corresponding different incoming angles of light selected by said light path selection 
elements at different times being recorded in a coordinated relationship for the 
individual pixels, the recorded light intensities representing different image received 
by said light receiving elements at different incoming angles of light and at different 
times, wherein a three- dimensional image including the different images is provided 
when the recorded light intensities are reproduced (Controller compiles data 
obtained from the detector to reconstruct images. This would require the recording 
of the coordinated relationships of the angles of the SLMs and the intensity of light 
received by the light detector; col. 16, lines 10-12, col. 22, lines 40-57; col. 7, lines 
60-col. 8, line 1; col. 23, lines 58-67; col. 24, lines 18-39); 

but does not expressly teach when the different images are reproduced by emitting light 
representing the different images at different outgoing angles of light and at different 
times, the different images are perceived by a viewer as a three-dimensional image and 
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are perceived by the viewer as a different three-dimensional image when the viewer 
observes the different images from a different direction. 

Holzbach teaches wherein different images (full parallax 3D images; col. 9, lines 
29-32) are reproduced by emitting light (LEDs in the lenslet projector modules; col. 9, 
lines 5-7) representing the different images at different outgoing angles of light (lenslet 
contains elements to direct light in the appropriate direction to create the parallax 
image; see also DMD of col. 9, lines 7-8) and at different times (inherent in a moving 
picture display; col. 9, lines 20-23), the different images are perceived by a viewer as a 
three-dimensional image and are perceived by the viewer as a different three- 
dimensional image (full parallax 3D images) when the viewer observes the different 
images from a different direction (inherent in an autostereoscopic parallax display; i.e., 
the depth resolution changes as the viewing position changes. "An autostereoscopic 
display allows an observer to move around within a wide range of viewing positions, 
always presenting the correct information to the observer's eyes." See col. 5, lines 21- 
24.). 

It would have been obvious to a person having ordinary skill in the art to have 
used the teaching of Holzbach with that of MacAulay in order to provide a system to 
present 3D information to an individual or group of observers without requiring each 
observer to wear special goggles or glasses. (See col. 2 , lines 40-49 of Holzbach.) 
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Claim 2, MacAulay teaches wherein each of the pixels is formed from one of said light 
receiving elements and one of said light path selection elements which are paired with 
each other (col. 17, lines 55-58). 

Claim 3, MacAulay teaches wherein the incoming angle of light selected by each of said 
light path selection elements varies as time passes (col. 22, lines 40-47). 

Claim 4, MacAulay teaches wherein each of said light path selection elements is a 
reflecting element which drives a reflecting plate for reflecting light to select the 
incoming angle of light which comes to one of said light receiving elements so that the 
light of the incoming angle is light reflected by the reflecting plate (SLM may be a digital 
micromirror device that reflects light to the image plane 40; col. 16, lines 39-46). 

Claim 5, MacAulay teaches wherein said reflecting element is a mirror plate, a Micro- 
Electro-Mechanical Systems element or a digital micromirror device (trade name) driven 
by a piezoelectric element (col. 16, lines 39-46). 

Claim 8, MacAulay teaches wherein said light path selection elements are liquid crystal 
waveguides disposed in front of light receiving faces of said light receiving elements and 
selectively vary the refractive index of liquid crystal filled in said waveguides to select 
transmission paths of light (SLM can be an array of ferroelectric liquid crystal device; 
col. 15, line 27). 
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Claim 10, MacAulay teaches a three-dimensional image pickup apparatus, comprising: 

• light intensity acquisition means for acquiring intensity information of received light 
(intensity of the light impinging on individual pixels in the detection array can be 
detected; col. 22, lines 44-45); and 

• incoming angle acquisition means for acquiring corresponding incoming angle 
information of the received light at different incoming angles and at different times 
(controller varies the orientation of the SLM and illuminates the object from a 
plurality of angles; col. 22, lines 40-45, col. 16, line 62-col. 17, line 9); the 

• intensity information and the corresponding incoming angle information of the light 
being recorded in a coordinated relationship with each other the recorded intensity 
information representing different images received by said light intensity acquisition 
means at different incoming angles and at different times, wherein a three- 
dimensional image including the different images is provided when the recorded 
intensity information is reproduced (It is inherent that the intensity information and 
the incoming information be recorded in a coordinated relationship with each other in 
order to be reconstructed as an 3-D image of the sample; col. 22, lines 45-50; col. 7, 
lines 60-col. 8, line 1; col. 23, lines 58-67; col. 24, lines 18-39) 

but does not expressly teach when the different images are reproduced by emitting light 
representing the different images at different outgoing angles of light and at different 
times, the different images are perceived by a viewer as a three-dimensional image and 
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are perceived by the viewer as a different three-dimensional image when the viewer 
observes the different images from a different direction. 

Holzbach teaches wherein different images (full parallax 3D images; col. 9, lines 
29-32) are reproduced by emitting light (LEDs in the lenslet projector modules; col. 9, 
lines 5-7) representing the different images at different outgoing angles of light (lenslet 
contains elements to direct light in the appropriate direction to create the parallax 
image; see also DMD of col. 9, lines 7-8) and at different times (inherent in a moving 
picture display; col. 9, lines 20-23), the different images are perceived by a viewer as a 
three-dimensional image and are perceived by the viewer as a different three- 
dimensional image (full parallax 3D images) when the viewer observes the different 
images from a different direction (inherent in an autostereoscopic parallax display; i.e., 
the depth resolution changes as the viewing position changes. "An autostereoscopic 
display allows an observer to move around within a wide range of viewing positions, 
always presenting the correct information to the observer's eyes." See col. 5, lines 21- 
24.). See the rationale to combine in the analysis of claim 1 . 

Claim 21, Holzbach teaches a three-dimensional image pickup and display apparatus in 
Fig. 14, comprising: 

• a light reception section (detector element 172) including a plurality of light receiving 
elements for receiving and converting light into an electric signal and 

• said light receiving elements and said first light path selection elements being 
arranged such that a plurality of pixels formed from said light receiving elements and 
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said first light path selection elements are disposed both in a row direction and a 
column direction (col. 10, line 47), 

• a light emission section (LED) including a plurality of light emitting elements for 
emitting light in accordance with an electric signal and a 

• plurality of second light path selection elements (light modulator DMD) for selecting 
corresponding different outgoing angles of light to be emitted from said light emitting 
elements at different times (col. 10, lines 47-62), 

• said light emitting elements and said second light path selection elements being 
arranged such that a plurality of pixels formed from said light emitting elements and 
said second light path selection elements are disposed both in a row direction and a 
column direction (col. 9, lines 9-15), 

• said light emitting elements emitting light in accordance with a coordinated 
relationship between the corresponding different outgoing angles of light selected by 
said second light path selection elements at different times and the intensities of light 
for the individual pixels based on the video signals to produce a three-dimensional 
image including the different images at the corresponding different outgoing angles 
of light and at different times (control both light intensity and light directions; col. 5, 
lines 13-17); 

• to reproduce the different images at different outgoing angles of light (lenslet 
contains elements to direct light in the appropriate direction to create the parallax 
image; see also DMD of col. 9, lines 7-8) and at different times (inherent in a moving 
picture display; col. 9, lines 20-23), wherein the different images are perceived by a 
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viewer as a three-dimensional image (full parallax 3D images) and are perceived by 
the viewer as a different three-dimensional image when the viewer observes the 
different images from a different direction (inherent in an autostereoscopic parallax 
display; i.e., the depth resolution changes as the viewing position changes. "An 
autostereoscopic display allows an observer to move around within a wide range of 
viewing positions, always presenting the correct information to the observer's eyes." 
See col. 5, lines 21-24.); 
but does not expressly teach: 

• a plurality of first light path selection elements for selecting different incoming angles 
of light to come to said light receiving elements at different times, 

• intensities of the light received by said light receiving elements and the 
corresponding different incoming angles of light selected by said first light path 
selection elements at different times being coordinated with each other for the 
individual pixels to form video signals that represent different images received by 
said light receiving elements at different incoming angles of light and at different 
times. 

MacAulay teaches 

• a plurality of first light path selection elements for selecting different incoming angles 
of light to come to said light receiving elements at different times (spatial light 
modulator, e.g. digital micromirror device 34, col. 16, line 62-col. 17, line 9), and 

• intensities of the light received by said light receiving elements and the 
corresponding different incoming angles of light selected by said first light path 
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selection elements at different times being coordinated with each other for the 
individual pixels to form video signals that represent different images received by 
said light receiving elements at different incoming angles of light and at different 
times (Controller compiles data obtained from the detector to reconstruct images. 
This would require the recording of the coordinated relationships of the angles of the 
SLMs and the intensity of light received by the light detector; col. 16, lines 10-12, col. 
16, line 62-col. 17, line 9, col. 22, lines 40-57). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have used the light path selection elements of MacAulay with the 
apparatus of Holzbach to provide a significant advantage in controlling the angle of 
illumination, quantity of light, and the location of light reaching the detector. (See col. 2, 
lines 54-64 of MacAulay.) 

Claim 37 is analyzed as an information recording method of the apparatus of claim 10. 

5. Claim 6 is rejected under 35 U.S.C. 103(a) as being unpatentable over MacAulay 
(US 6,483,641 ) in view of Holzbach (US 6,795,241 ), further in view of Moranski (US 
6,094,289). 

Claim 6, MacAulay in view of Holzbach teaches a three-dimensional image pickup 
apparatus according to claim 1 , but does not teach wherein said light path selection 
elements are driving members which carry and drive said light receiving elements to 
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vary the directions in which light receiving faces of said light receiving elements are 
directed. 

Moranski teaches driving members which carry and drive said light receiving 
elements to vary the directions in which light receiving faces of said light receiving 
elements are directed (photodetector 216 disposed on a free end of a cantilever beam; 
col. 13, lines 14-23). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to have used the driving member of Moranski with the 
apparatus of MacAualay in view of Holzbach in order to avoid a movable structure that 
is susceptible to mechanical fatigue and failure. The cantilever beam is a solid state 
device which has extremely high reliability. (See col. 2, lines 1-15 of Moranski.) 

6. Claim 7 is rejected under 35 U.S.C. 103(a) as being unpatentable over MacAulay 
(US 6,483,641 ) in view of Holzbach (US 6,795,241 ), further in view of Sun (US 
6,415,068). 

Claim 7, MacAulay in view of Holzbach teaches a three-dimensional image pickup 
apparatus according to claim 1 , but does not teach wherein said light path selection 
elements are lenses disposed in front of light receiving faces of said light receiving 
elements and drive said lenses to vary relative positions of said lenses to said light 
receiving elements. 
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Sun teaches wherein said light path selection elements are lenses disposed in 
front of light receiving faces of said light receiving elements and drive said lenses to 
vary relative positions of said lenses to said light receiving elements (col. 3, line 66-col. 
4, line 7; col. 6, lines 10-16). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to have used the microlenses of Sun with the apparatus of 
MacAulay in view of Holzbach since the microlens switching assembly provides a fast 
switching of signals and a small required driving force. 

7. Claim 9 is rejected under 35 U.S.C. 103(a) as being unpatentable over MacAulay 
(US 6,483,641 ) in view of Holzbach (US 6,795,241 ), further in view of Hosoi (US 
6,400,490). 

Claim 9, MacAulay in view of Holzbach teaches a three-dimensional image pickup 
apparatus according to claim 1 , but does not teach wherein said light path selection 
elements are Mach-Zehnder elements disposed in front of light receiving faces of said 
light receiving elements and each selectively varies the refractive index of a phase 
control section provided in a light path to cause interference of light to select 
transmission paths of light. 

Hosoi teaches wherein said light path selection elements are Mach-Zehnder 
elements (12). 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to have used the Mach-Zehnder waveguides of Hosoi with 
the apparatus of MacAulay in view of Holzbach since the Mach-Zehnder optical 
modulator is stable with respect to disturbance and can obtain modulation 
characteristics featuring excellent signal-to-noise ratio. (See col. 1, lines 15-25 of 
Hosoi.) 



Conclusion 

8. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See M PEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CHIA-WEI A. CHEN whose telephone number is 
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(571)270-1707. The examiner can normally be reached on Monday - Friday, 7:30 - 
17:00 EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Lin Ye can be reached on (571) 272-7372. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Lin Ye/ 

Supervisory Patent Examiner, Art Unit 2622 
/C. A. C.I 

Examiner, Art Unit 2622 



